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ABSTRACT + ,_. • 

i - ■'//'■■ A schema-based technique designed to improve 
students ' use of feedback on their performance on classroom tests was « 
partially tested. Subjects were. 16 female undergraduates separated 
into two groups based on grade point average (GPA) . The trai-ning 
program fequired^that one class ^ each* classroom exam be . j 

used as a feedback session. A 50-item multiple-choice pretest, fqur* 
midterm exams, and one' final were administered .The Reparation of 
subjects into high and, iow ability groups for ( the purpose of analysis 
provided groups that differed in ability as well as GPA. Lower 
ability students improved in their processing of feedback, as 
demonstrated by error analysis. Limitations of the < study and" • r 
implications for education and for the use of schema theory for the' 
development of instructional techniques are discussed. (Author/PN) 
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ft scherra-based • technique designed to iri^gc^^k^^^g^^i^; of ; .' - 
feedback on their perfdnti^Ge on classroorp^^ 



tested. Eov^r ability subjects improved in -^pi^^r^essing, of 
fe&dbackf demonstrated by an error analysis;' St^ii^tions 



for education and the use of schena theory for the devel6pro^i^||^ 
of instructional techniques are discussed . ',J?™Qi- 
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Irrproving the. _ Use o£* classroom Feedback 



.; Feedback follcwijig classroom- tests should be both formative 
and sunnative. In other words/ students should treat examination 1(1 
performance feedback as a; source of information for further ;">..' 
learning. If this information as efficiently processed, learning 
should iit5>rove. This study consists gf a brief description * and 
analysis of 'a simple training tediiigue designed to facilitate 
students 1 use of feedback on classroom multiple-choice test ■ ■ ■ 
performance. Bender & Phye (1979) found all students do not v : 
benefit frcrn feedback sessions equally. . Higher ability students 
may more Gainfully review each item than may lower ability students; 
The training technique was designed to improve students 1 use of; 
feedback in classroom examination feedback sessions. 



Effective use of feedback is considered to be a trainable 
v- ' ''.'i||^.;;sKill. This skill is conceptualized as a type of procedural schema ^ 
'■ ■■^j^^er, 1979; Rumelhart § Norman, 1981). Figure 1 illustrates tfig~~^ 



Insert Figure 1 about here 



general prcScedure in such a schema. Students fchb use this type of 



seJiofa "should be malcind the most efficient use of feedback; for 

correcting incorrect, items ,and for clarifying items about which the 

; students were unsure. The training program consisted l b£ ■ building 

.'•■**- ■ , 

these schemata by inf ormiii^tlie students; o£ the functions of - 

.« ■. ■ 

effective feedback and providing them witfr a procedure designed to 
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facilitate the^fulfiilirient of:, these functions . 



V . Effective .classroom feedback serves three ;fitoctibns . FeecJbadc ■; 
".: . Sisc^nf in^ incorrect kricwledge.^ Disconf ii^tion : would opcur with . ° 
a negative response to; the first, question in Figure £. ; Disconfirmed 
information is also corrected by informative feedback. CorrectibS 
wuld^cur with the processing of iiiformtidn jfroa varidi^ : sources'; • 
following disconf inration . Finally f feedback /confirins trie - . 
appropriateness bf the correct responses about which students' were. 
: \ ' unsure. This confirmation function, occurs' through the processing V » 
■:- . of inf ormation f ollowing re^ew of ' a correct item. \ '■ ( '.. 

*' ; If feedback does hot serve these functions , arid a pretest- ; 
I > .. posttest design is employed in instruction, a number of error * * 

patterns oherge (Phye f Guglieneila,.- & Sola, 1976). A perseyerative 
error occurs when feedback is not processed and the, student fails ~ 
V : . an item by chdosing the same incorrect response on Wch test. . A 



different error occurs when feedback disconf irms, buK does not 
correct the student's knowledge schema'* ° Tfte; studenj^tails ah ileS 
on the posttest by chooing a differint f hut still incorrect-- 
alternative. Finally, a new error occurs when feedback does not 
confirm information ; therefore/ the s\qdgr>fc fails a previously V 
correct item. ■ If students rasre informed of the functions of 
feedback/ then trained how to use feedback sessions to facilitate 
these functions, their use of feedback sessions should iirrorove. 

'■ \ 1 / V _ _ I _ . • - ■ . " : ' 

This iitproved use of feedback should appea^ in the error patterns* 
cotttnitted by the students, especially. the lower ability students. \_[' : . 
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Method 



Subjects 



/• 3 7 



! I 



./ Sujpe|bt3? were 16^tudents,frcm introductory' psycholc^ 




at/a<anal^ private, liberal^arts college f or -wbrreftL S|tud&its were 



elected on : -;thei basis of attendance and were separated jinto two ' ~ 

. l l_ ■ _ _ ' /••„.. ■■' s ' \ >'}*.' . ' 'I'- - ; " ) ' • 

ab^lit^ groups; on the basis of first semester grade point average. 



.e 'se^araticaiiirito ability groups Was for the analysis only. 

; ; ; Th£ . tuning program required one class meeting following each' 
-h clas^rbOT ekam be used as a feedback session. During the first 
feedback session, students were informed ot the functions of 
' ; 'effective feedback. ; Students were then told they, would be given . 
their corrected answer sheets and a copy of the exam* and that they 
should review the exam in the fol lowing manner. First, they should 
note those items they answered incorrectly and note, the correct 
answer. Second, they should search the text and their notes, for 
support for the correct answer. .... Third, 'they should review those 
items they answered correctly and review the text and notes 
> concerning those items for* which they were uncertain, if students 
were\ unable to locate informatiai concerning an item, they were to 
-'. .. ask the instructor, who -provided the information and its location. 
__ All^ubgectslt^^ — — — 



y 



pretest, four midterm exams f and one final./ The, pretest consisted , 
of* five sets of ten items each, f rem each fifth of the course. The 
appropriate set: of items was repeated on each midterm and the final. 
Ten new items from each midterm w^re repeated on the final. The / 

■ ■ ~ " ■ ' 

-' Of ; 
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final also contained pew itars f ran the last fifth- of the course. 
. All o^ the repeated itens were bitten before the banning' of the 
" term and covered -a wide sample of the course content. • 

'Review sessions followed the four midterms and lasted for the 
entire 50-ntinute class period, subjects were not allowed to keep 
.,: their exams or to copy items. To further control for the amount of 
exposure to eadr exam, the number of hours spent reviewing the 
. exams outside of the classroom was also recorded for each student. 

* . Results ' 

The proportion of ^corrected items, new errors, perseverative 
\ errors, and different errors were recorded for both the pretest 

— . - ' - - - - - A 

items repeated on the midterms, and the midterm items repeated on\ 
-,the final. The proportion of new errors was^ based on the number 
correct iii the initial test, while the proportions pf perseverative 
, ■ ' and different errors were based pn the number of items which were 

incorrect on both tests * This scoring procedure differs slightly ; 
: frcm that of Bender &• 2hye . (1979) .i The total: nuirfoer of points for 

'the coiirse, the number of repeated midterm items corr^et on the > ' . 
• v final, and the? : tqtal final , raw score were also recorded. ' \ ' • 

Indepentent t-tests were used to compare the dependent measures : 
between ability groups; Higher ability subjects* had. a a higher mean / 

i : . GPA-than the lower., abi lity _.sub jec^ _t ( 1 4.) =_:6. 8 6 , „.p,<: , 001", with..a . 

; mean GPA for higher and lower ability groups of 3.35 arid 1.95, 

■ y- _ . \j J- . ,* * ■ . ' . . . 

respectively. . Higher ability subjects corrected a greatet proportion 
of errors from the pretest to the midterms t(14) = 2.28, p<.05, 
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with mean . arcsin 'transformed proportions of corrected .errors for 

■-■ — — — — - — • s ■— '• . 



'"V 



one-way repeated, measures ANOVAs ^for each error typei-and "the 
proportion of corrected errors. No dkanges were found for the high 
ability subjects . < £bw ability subjects raproved in the proportion;, 
of errors corrected F(l,7) = 10.14^6^p < .05, with mean transformed 
proportions of corrected errors of 1.67 and 2.26 for the midterms . 
arid final, respectively. Low ability subjects "also reduced their i 
proportion of different errors F(l,7) = 8.0095, pi .05 , with mean 



' . the high and low ability groups of 1.99 and 1.6.7, re^ectively... 

V- High ability subjects also .^omatted ; a lower proportion of 

perseverative errors *f ran the pretest -td the midterms, t(14) =.2.30, :i 
. p< .05, with mean transformed proportions of perseverative errors ■ 

for high and low ability groups of 0.78 and 1.05, respectively. No 

f ' • .' , ';• '. : ■ .• 

significant differences were found between the performances of, the 
high and low ability groups as reflected by error patterns from 
the midterms to the final. 

Higher ability ^subjects scored higher on the. overall final 

# . ■. * _ _._ •' ^ _ - ' - ' 

t(14) = 2.17, p < .05 j±L0n did lower ability subjects, but not on 

■ ■ ' v - ' . ' ' ■_ ■ _ . * [ ■* 

items repealed fron the midterms.' The mean final score for the ^ 
high and low ability groups* was 57?. 875 and 48. 37S, respectively/.- 
Hi^ier ability subjects^also attained more' total points for the ' 
course;. t(14) = 3.11, p< .0^ with mean total points for high and 
low ability subjects of 220.75 and 195, respectively. Nb different 
* were found in the total number of hours spent reviewing the exams. 
.Changes in performance within ability groups were analyzed by 
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tfansforSed proportions of dif f er^it enror s ^iron the midterms cind 




^ final of 0>&1 and 0.38, respectively. 

.Discussion 



The s^^ra^^n^of siab jects into high and low ability grdiips 
* for the pwcpose xof analysis did provide groups which differed in 
ability as well- as GPA. Error patterns from the pretest to the; ■•; 
midterms reflect learning f ran the text and lectures. Higher ; 

/ability subject^ appeared to v have benefited irore f rem o instruction 

; . • • . •/.; • ' ■ , • • v >i/; ' . . '. •• ° : ;'• 

than l d£d lower . ability subjects. The; result^ for the perseverative 




errors indicate that ^iiist^ction may have ; y?er^ed to correct the 

• i^j^prect preconceptions ; bet€Sr for the hi^h ability subjects, than 

for the lower ability subjects. • ! ; V ' v * 

■ :; •• . - - .'; ; \ •■. -'•(■•'; . • .". • , , ' .* '-. ' - - '. :J-.' 

Error patterns from ttfe midterms to the final ^reflect learning 

• from feedback ^sessions. Previous research indicated titet lower • 
. ability subjects may process, feedback less effectively than do • 

higher abilit^ Subjects L ( Render & Phye, 1979 L.v Unfortunately, 
this result could not be replicated r as there were Vhb; high or low ^ 
ability subjects who did not receive the feedback training in this : 
study . • However , f e^foack training sessions aj^)eared to have ^ v 

- \.' •■ -■ - - ■ - • * : . ^y,.J»;. . — •:- ./ ' • . _^ • ■ *T '. ..•-'»•'- 

inprbyed' the ptocessing 6f ^feedback on classrocm '^cams ;$E ' ; t±e.^ ' • ^ 
lowe^ ability subjects. This dirprovenent was Vref lScted' in the, • . H 
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inproyeri^nt of tlje proportions of ^rrecfeed^and diffeipil^ errdts 
to, S level: v^ch was rKDt signif ica^ c^ffer^ht frcm.that.bf . the 



^ ability subjects; Learning t±e functions ^ of f^edbagk and 



•h©w r td use ;fee^Lck sessions ••. to, fulfill, these functions . he 



Ik. 



lower ability subjects develop more effective:. procedural ,sch£mata 
for feedback sessions. , \ ;V' :: '■ ' r ■ .;. ^. v - > 

* . ffi^^lre^iiits iiliis^ate tSe potential usefulness- of schema ' 

: \ thebry in" the design c of ; : i^ techniques . Schema theory 

is a very eclectic , <3ivfer|e area of cognitive psychology*: " Sdferafea 

1 have been defined" in various foays . The term is used in a very 

; . .' . j.' • •' _« -i' _ <L !_■ . . .-J : _.' '„_ . ' 

^ v - : g^aieral sense here to mean a functional label for any set of mental 
processes which occ^ ; together regularly and are used to represent 
■ :. information or strategies. A f or using information. \ Thus 9 schema ,may 
be reducible to physical .events which occur within the 7 brain / and 
may be corrposed' of separately identifiable events. However , it rinay 
^not be necessary for ev£ry learner to have identical physical 
; events occurring within the brain when solving identical problems. . 
The i^ntal processes are inferred from behavior, and the term . 
sch^na is a functional label- for these processes. Therefore,' 
schema survive only through their demonstrated usefulness.. . /"^ 
The. results of this study start to demonstrate the usefulness - 
. - 4 of the coiceptibn of a schema for the use of classroom feedback, : 

Although this study involved; tjie use of classroom exaip .perforinance f 
wi'^ feedback, the func^on> of feedback in any, information-processing v 
'V;;s|tm^OT is tiie, ^9mp^ : fii a i^S^o^i^^ monitoring system of ^ 
' jipr^^ 1 013 ) f eedback; is, used^o; cKim: p^ ; ^ 



; appropriateness, of curi^nt 
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" • r : Although the results are encouraging for the development of 
practical instructional techM from schema, theories, there are 
, & nuiriber of limitations of this study which should be considered 
• ; to prevent the possibly premature application of these results to • 
; the general cla$sroatiJ The first limitation concerns' the mathocl: 
■ ; . The sarnple of subjects was very small, and select. There* was rio 
? randcm assignment of : the: subjects to conditions ; as the conditions 
were determined by GPA. Furthermore, no control group which did 
,fidt receive instruction in the use of feedback was included. 
• *' "Generalizations ;should not be made from any single study. s . 
"V Replication of these results , with a variety of classes and ' \ . ' . 

appropriate; control groups needs to be* attempted. ; ... ,>••/. ~ :\. 

> ; - * The ; secpnci limi^tion eqncertis the f inding that the low 

ability subjects appeared to ijiprove only. on the repeated /items. ; • 
Appare^^ of feedback does irrprdve the 

perfonrarice of lower ability isubjicts on repeated itens. ' However, 
,'■ 5 ;jit . is -not clear whether this improved performance is due to better 
knowledge of the material; or memory for the specific answer to a 
specific question. Therefore, paraphrased as well as v^batim ' 
"'M items ne^d to be used in the ~posttests. 

Finally, instruction ^^^^^^ use of feedback is nlt^X'panacea 
f, . ; ; fbr the differed 

~ ■ subjects ^ 

[$[ ; agp^Sr to Si bfetter general information processors. Instruction ; ' [ 



.v.,.' ■ 
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;:. ■•: : V.- : : ■■ ^''r : -J 1 -. 

in the use of feedback may" iigrove ; the processing scherra^of lower ' 

' " . . •. ■ ■ " , ■ - 

'ability learners in this drii Wj^ct of informtion processing. 



Other instructional 



•4 



be 



to improve 



the information processing of theW^leiriiers in other' areas. 

! .'. In conclusion r it may be possible td-lhelp learners develop - . 



for 



use of feedback in the cl&ssrooft teifch a technique 



designed to facilitate the .c^nfir|hihg r disconfirrtirig, and correcting, 
functions of effective feedback. The technique, designed in /this 
study: was especially effective in iiiproving the use lower ability; > 
subjects made of feedback on specific multiple :: *choice problems . /. 
With more research,, using proper control groups and paraphrased; 
'. pdsttest items/ 1 . it may be possible to demonstrate that training in 
the use of .feedback can ifnprove the general feedback processing of 
learners in a variety of tasks. Finally, the utility of schema 
theories for use in developing instructional tediniques designed 
to facilitate the information processing of leainers has been 
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Figure' 1. Procedure for effective use of classroom feedback. 
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